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PROGRAM  MANAGEMENT  AND  INTERACTIVE  fWNAGEMENT 
DECISION  SYSTEMS 

Introduction 

The  Issues  raised  by  Galbraith  In  his  paper  provide  the  context  for 
this  discussion  of  the  Impact  of  Information  technology  on  the  program 
management  task.  The  management  of  large  technological  programs  was 
chosen  by  him  for  three  reasons;  its  importance.  Its  general  pervasive- 
ness in  all  areas  of  human  endeavor,  and  its  implications  for  organizational 
design.  The  material  discussed  in  this  paper  Is  particularly  applicable 
to  this  specific  problem.   Large  technological  programs  are  sensitive  to 
information  lag  because  of  the  integration  of  specialists  and  the  other 
issues  that  Galbraith  raises.  Changes  in  control  concepts  and  the  tools 
available  for  planning  and  control,  particularly  computer  technology, 
can  affect  this  Information  Sag,  and  other  aspects  of  the  program  managerrent 
function. 

Hov/ever  the  Management  Decision  System  (MDS)  that  is  discussed  in 
this  paper  Is  not  only  useful  in  the  program  management  context,  it  is 
Increasingly  applicable  across  the  management  function.   Many  industries 
are  faced  with  a  continuing,  and  increasingly  rapid,  change  in  technology. 
Their  own  production  processes,  materials  and  new  products  often  Involve 
a  higher  level  of  technological  sophistication  than  in  previous  years. 
This  not  only  increases  the  communication  problems  between  functions  but 
can  even  mean  that  the  implications  of  a  decision  within  a  function  are 
counter-intuitive  for  the  manegcrs  involved.  This  change  in  technology 
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coupled  with  the  increasingly  short  life-cycle  of  products  in  some'  in- 
dustries produces  many  of  "the  samo  problems  for  managers  as  one  sees  in 
the  large  technological  programs  as  typified  by  those  in  the  Aerospace 
business. 

Thus  many  companies  with  products  v/hich  have  a  high  technological 
content  have  management  decisions  which  are  getting  more  complex  as  the 
concepts  and  production  processes  keep  changing.  This  results  in  the 
familiar  problem  of  marketing  people  being  unable  to  communicate  properly 
with  the  production  or  purchasing  people  and  so  forth.  Similarly  many 
conglomerates  are  unable  to  communicate  effectively  between  groups.  The 
concepts,  technology  and  language  in  one  group  are  not  ful ly  understood 
by  the  other.  With  the  continuous  movement  of  managers,  the  short  life- 
cycle  of  the  products  and  the  changing  technology,  there  is  not  enough 
time  to  slowly  work  out  of  the  communication  problem,  and  evolve  a  common 
set  of  informal  decision  models.   In  a  stable  and  slow  moving  environment 
each  manager  involved  can  build  for  himself  an  internal  'model'  of  his 
environment  andiway  it  v/orks.  As  the  pace  picks  up  these  old  models  be- 
come invalid  and  managers  do  not  have  time  to  construct  new  ones.   It  is 
in  such  an  environment  that  a  MDS  can  be  useful  and  of  course  program 
managcmsnt  almost  invariably  involves  such  an  environment. 

We  would  like  to  be  able  to  use  the  new  technology  available  in  the 
information  systems  field  to  increase  the  quantity  and  quality  of  relevant 
information  to  the  mangers  Involved  in  the  program  management  function. 
Computers  can  be  used  very  effectively  for  these  high-level  line  managers, 
but  not  in  traditional  v/ays,  such  as  historical  reports  based  on  traditional 
accounting  data  from  a  batch  processing  computer  system.  Typical  management 
information  systems  bui't  around  batch  processing  computers  are  most  useful 
for  structured  problems.  That  Is  problems  that  have  well  defined  methods 
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of  solutions,  and  that  are  predictable.  The  program  managen;ont  function 
Is  largely  ujvitriirturff^  p"'"'  r?''V''"'ez   o   different  kind  of  support  If  the 
organization  is  to  buy  slack  resources  v/ith  the  use  of  information.  To 
do  this  wc  propose  the  use  of  a  Management  Decision  System,  the  components 
and  implications  of  which  are  raised  below. 

To  provide  some  context  for  this  paper  the  place  of  a  MDS  in  the 
overall  control  process  can  be  thought  of  as  follows: 

Figure  I 
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The  objectives  (Px>x  number  I)  of  the  oryanizcstion  are  a  prcroquis i"te  for 
all  that  follows.   The  critical  process  of  determining  these  is  discussed 
briefly  below,  but  not  In  the  depth  It  deserves. 

The  objectives  determine  the  key  variables  (2)  that  are  to  be  used 
to  monitor  progress  toward  the  objectives.  These  key  variables  and  the 
objectives  help  to  determine  the  organizational  structure  (3)  to  the  ex- 
tent it  is  possible  to  alter  it.   Similarly,  given  the  organizational 
components  which  cannot  be  altered,  this  helps  to  determine  the  nature  of 
some  of  the  key  variables.  The  management  control  system  (4)  in  turn  is 
designed  to  monitor  the  key  variables,  given  the  organization  structure. 
Thus  the  managemsnt  conrroli  system  should  be  dependent  on  the  three  pre- 
ceding constrnlnts. 

The  final  components  (5),  the  management  Information  system  and  the 
management  decision  system  should  be  designed  to  support  the  management 
planning  and  control  process.  V/e  discuss  below  the  recent  changes  In 
technology  as  they  affect  the  management  Information  and  decision  systems. 

Components  of  a  Management  Decision  System 

The  components  of  a  Management  Decision  System  have  been  discussed 
In  some  detail  elsewhere  .  Figure  2  provides  a  representation  of  the 
major  elements.  ^  ,\^ 


,  o 
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The  managers  (I)  and  their  problem  are  provided  with  access  through  ^  '*"^<-^^' 
an  Interactive  visual  display  terminal  to  the  central  computer,  models 
and  data-base  of  the  system.   Tor  complex  unstructured  problems  the  ter- 
minals (2)  should  be  visual  displays  capable  of  drawing  graphs  as  well 
as  the  normal  character  set. 


See  M.S.  S.  Morton,  Mu  inor.icnt  Decision  System:.,  Harvard  Business  School 
Division  of  Research  ( forthconing) . 


Figure  2 
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The  central    computer  (3)   should  ^nppori  mijifiplp  ii^-p-rn  on  a   remote 
basis  but  need  not  be  time-shared.      The  software  and  models   (4)   are  the 

most  critical    element  and  should  be  designed  to  support  tlie  manager   In 

2 

his  decision  process  .  The  software  has  to  be  designed  to  support  the 

manager  on  his  own  terms.  ,to  provide  flexible  and  simple  access  to  the 


data  and  models.  This  is  a  complex  and  non-trivial  task  but  our  experi- 
ments have  shown  that  it  can  be  done  effectively. 

The  last  component^  the  Data-Dase  (5),  contains  the  on-line  data 
necessary  to  support  the  models  and  the  managers'  decision  process.  There 
Is  one  Important  clarification  to  be  made.  The  on-line  characteristic  of 


the  data  provides  immediate  response  to  a  question  or  request  for  computation 
by  the  maxia^i»p.,— Th i s  is  to  be  carefully  differentiated  from  having  the  data 
maintained  in  real-time.   In  many  applications,  including  some  program 
management  applications,  the  data  does  not  have  to  be  absolutely  current. 


"Morton,  M.S.S,,  "Development  and  Evaluation  of  an  Interactive  Display  System 
for  Management  Planning"  in  Management  Information  Systems:   Progress  and 
Perspccti  ves,  Carnegie-Mellon  University  (forthcoming). 

Ntorton,  M.S.S.,  "Computor-Qri  vcn  Visual  Display  Devi  ces— Thei  r  Impact  on  the 
Management  Decision-Making  Process",  Doctoral  Thesis,  Harvard  Business  School 
June  1967. 
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Of+en  (iriia  theii  is  several  days,  or  even  a  week  old,  is  adequate.  However 
iifihiedi  ate  response  during  a  problem-solving  session  is  important  if  the 
decision  process  is  to  proceed  at  speeds  comparable  to  man's  natural  thought 
process.  This  differentiation  betv/een  the  currency  of  the  data-base  and  the 
response  tirre  of  the  system  is  an  important  one  to  have  clearly  in  mind. 

Our  experiments  have  shown  that  the  key  features  of  such  a  management 
decision  system  when  used  in  an  unstructured  management  situation  are: 

1.  Simple  to  opcrato,  so  that  an  executive  with  no  computer 
knowledge  and  a  busy  schedule  can  use  it  comfortably. 

2.  Interacti  ve,  so  the  system  responds  readily  to  user  rcquesis, 
and  does  not  hinder  the  user's  natural  problem-solving  process. 

3.  General  purpose,  in  order  to  be  applicable  to  many  parts  of  the 
business. 

4.  Modul ar,  to  absorb  changes  In  the  software  and  a! low  for  the 
addition  of  different  forms  of  data. 

5.  Hardware  independent,  to  allow  change  of  terminals  with  ad- 
vancing technology. 

The  use  of  interactive  decision  systems,  such  as  the  one  described 

above  has  been  limited  thus  far.  This  seems  to  have  been  due  to  at  least 

three  factors: 

'•  The  first  of  these  has  to  do  with  our  concepts  and  understanding 
of  management  planning  and  control.  Such  sysfems  require  the  user 
to  have  thought  through  his  decision  processes,  identified  the  most 
critical  decisions  and  analyzed  them  carefully  to  identify  the 
kind  of  decision  support  that  is  necessary.  Only  cerialn  kinds  of 
decisions  can  Justify  the  sort  of  power  available  with  an  MDS. 
This  analysis  is  a  difficult  step  to  take  and  has  very  often  failed. 
One  can  find  experiments  which  have  been  run  with  displays  which 
provided  the  manager  with  access  to  informoiion  for  which  he  had  no 
real  need — or  in  other  cases,  information  which  could  have  been 
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provided  adequately  by  a  manual  or   Batch  system.   The  failure  of 
the  display  system  has  then  been  attributed  to  the  i nappropriateness 
of  interactive  display  systems  for  managers,  whereas  in  fact  the 
failure  v/as  5n  selection  of  the  problem,  the  quality  of  the  analysis 
or  the  implementation  strategy. 

2.  The  second  major  factor  in  the  failure  of  more  widespread  use  has 
been  with  the  cost,  and  lack  of  familiarity,  of  the  hardware  and    ^^^y 
software  required.  Costs  have  been  high,  but  are  rapidly  dropping. 
Appropriate  graphical  interactive  displays  cost  $l!JO,000  two  years 
ago.  An  equivalent  system  is  now  S50,000  and  some  experts  expect 
costs  to  fall  by  50^  in  the  next  two  years.  Already  for  example 
a  roughly  comparable  system,  althought  with  slightly  less  pov/er, 
based  on  the  storage  tube  technology  is  available  for  SI5,000. 
Software  strategy  and  development  of  general  systems  has  been  slow 
as  users  fee!  their  way.  This  is  changing  as  we  pass  through  the 
first  v/orking  systems  and  companies  develop  their  second  generation 
of  applications.  Hardware,  software  and  our  concepts  have  all 
reached  the  point  whore  we  can  do  something  effective.   It  remains 
for  users  to  try. 

3.  The  third  reason  is  closely  related  to  the  second.  Costs  are 
not  a  problem  if  the  investment  can  be  shown  to  have  a  good  return. 
Similarly  high  start-up  costs  can  be  mitigated  by  using  the  experience, 
or  the  actual  programs,  on  subsequent  applications.   For  both  of 
the^e  reasons  It  becomes  important  to  have  good  measures  of  the 
effectiveness  of  any  application.  Unfortunately  research  in  this 


t 


field  is  made  di  f f  icul t  by  the  problems  inherent  in  measuring  the 


impact  of  any  new  system  on  a  manager's  decision  making  skills.   The 
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Intanglbles  are  many,  and  skill  i  r,  needed  in  research  design  if 
significant  evidence  is  to  be  collected  to  shov/  Ihe  correct  cost/ 
benefit  picture  for  such  systems. 

Impact  of  a  Kanagenent  Decision  System 

Although  this  technology  is  new  there  have  been  at  least  two  successful 

Installations  of  such  systems  in  a  management  setting  and  several  less 

successful.  The  "successful"  ones  had  a  significant  impact  on  the  decision 

process.  The  larger  of  these  projects  resulted  initially  from  an  academic 

experiment  but  has  had  continued  line  manager  use  for  two  years  since  the 

initial  experiments,  as  v/el  I  as  expansion  to  other  problem  types.  The  less 

successful  applications  that  the  author  has  examined  all  resulted  in  a  not 

gain  in  user  knowledge  but  did  not  have  the  intended  effect  on  the  manager's 
decision  process.   Evidence  from  all  these  sources  suggests  five  clear  kinds 

of  impact  on  management  decision-making  and  the  related  information  flows. 
Each  of  these  is  discussed  in  general  terms  bolow,  where  there  is  relevant 
specific  evidence,  this  has  been  cited,  although  the  Bibliography  contains 
the  original  sources  of  support.   Some  of  the  support  for  these  issues  is  of 
a  much  more  speculative  nature,  derived  by  osrtt)sis  from  working  with  such 
systems.  The  major  thrust  of  these  comments  seems  to  be  wel I  supported 
from  our  experimental  work.  However  specific  findings  should  all  be  regarded 
as  tentative  because  we  do  not  have  enough  experimental  evidence  to  justify 
each  aspect  of  the  major  points. 

The  evidence  collected  thus  far  establishes  beyond  any  doubt  that  such 
systems  can  be  built  vath  the  current  technology.   Line  and  staff  managers 
can  use  such  systems  for  certain  problems  and  find  them  to  be  capable  of  sup- 
porting their  decision  process.   The  net  effect  can  improve  the  quality  of 
staff  work  in  analysis  and  can  have  an  impact  on  the  decisions  reached  by 

line  managers,  particularly  Program  Managers. 
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The  issues  that  remain  to  be  established  in  detail  are  to  clarify 
the  types  of  problems  for  which  such  systems  are  useful,  to  understand 
the  analysis,  design  and  implementation  phases  and  to  improve  on  the 
reasurement  process. 

There  is  no  doubt  that  not  all  managers  will  have  problems  that 
necessitate  their  personally  using  the  system.  The  major  issue  hov/ever 
is  v/hether  the  system  v/i  I  I  change  the  decision  process  and  the  quality 
of  the  final  outcorno. 

One  problem  for  which  the  MDS  is  eminently  suited  is  that  of  program 

management.  This  problem  type  is  often  complex,  unstructured,  involves 

large  quantities  of  data,  uses  models  and  requires  inputs  of  managerial 

judgment.  These  five  problem  characteristics  are  those  for  which  a  MDS 

can  bo  of  considerable  help.  The  computer  has  a  relative  advantage  in 

handling  the  models  and  the  high  data  volume.  The  terminal  allows  the 

manager  to  input  his  judgement  and  to  provide  the  kind  of  structure  he 

wants  in  the  otherwise  unstructured  situation.  When  a  MDS  is  used  for 
problems  of  this  type  our  experiments  have  shown  the  following  five  major 

kinds  of  impact: 

I .  Clarification  of  issues 

We  have  made  the  assertion  that  the  MDS  is  most  useful  for  unstructured 
problems  and  that  the  program  management  function  has  many  significant  un- 
structured components.  This  lack  of  structure  creates  two  difficulties. 
The  first  of  these  is  the  difficulty  of  finding  the  problem.   In  a  poorly 
understood  system  many  signals  from  the  control  system  will  be  caused  by 
symptoms  of  the  problem— not  the  real  underlying  cause.  Probing  and      /^  y^^ 
searching  through  ti^e  data  by  a  competent  manager  can  often  provide  enough 
clarification  to  define  the  problem. 
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The  second  difficulty  caused  by  lack  of  structure  is  the  riiu  I  ti-dimen- 
sional  ity  that  is  almost  inevitably  involved.   Complex  programs  have  many 
significant  dimensions  (time,  cost,  risk  exposure,  etc.)  along  which  progress 
con  be  measured.  Any  particular  reporting  structure  can  only  present  a  fev; 
variables  at  a  tim,e,  and  often  these  have  had  to  be  prespecified  well  ahead 
of  time.  V^ith  the  MDS  one  can  easily  look  at  the  variables  that  are  rele- 
vant at  a  particular  moment  in  time — and  along  any  dimensions  that  seem 
appropriate. 

To  be  able  to  search  for  problems  and  deal  with  the  multi-dimension- 
ality involved  implies  that  two  key  features  are  present.  The  first  of 
these  is  an  appropriate  data-base,  which  in  turn  poses  three  requirements: 

a)  The  scope  of  the  available  information  clearly  has  to  be  rele- 
vant 1o  the  decision  being  made  in  regard  to  the  program.  This 
implies  some  prior  analysis  so  the  right  quantity  and  level  of 
data  can  be  maintained  on  an  ongoing  basis. 

b)  The  structure  of  the  data-base  is  also  important.  To  retrieve 
data  in  a  flexible  and  rapid  way  involves  questions  of  file 
design  that  are  complex.   For  example,  a  hierarchical  data- 
structure  serves  very  effectively  if  the  general  thrust  of  data 
needs  are  known,  while  an  associative  I ist-si ructured  file  pro- 
vides greater  flexibility  at  an  increased  cost  in  retrieval  time 

"^  and  size  of  storage  required. 

c)  The  cost  accounting  and  other  financial  data  hove  to  be  collected 
and  maintained  at  a  level  fine  enough  so  that  they  can  be  re- 
aggregated  in  whatever  way  is  called  for  by  the  user.  This  im- 
plies some  care  with  the  definition  of  costs  and  cost  centers. 
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Thc  Eocond  feature  that  rnur.t  be  preseni  to  allov^  the  user  to  search 
for  problems  and  deal  wi  Ih  i  he  rnulti -dimensional  aspects,  is  the  graphical 
capability  of  the  MDS.  Ttio  communication  Inherent  In  graphical  presentation 

of  data  is  much  greater  thcsn  tabular  data.   Imaginative  use  of  graphs,  with, 

■  — 

for  example,  several  variables  plotted  on  each  of  four  sets  of  axis,  can 
greatly  Increase  the  meaning  of  a  given  sot  of  data.   In  browsing  through 
the  data  to  find,  or  substantiate  a  problem,  or  to  test  the  implications  of 
several  possible  solutions,  it  becomes  important  to  have  a  technique  that 
provides  high  information  content.   In  many  decision  situations  more  information 
Is  conveyed  in  a  shorter  firm   with  graphs  as  opposed  to  tables  of  data. 
Also,  in  some  situations  it  can  be  effective  to  use  three  dimensional  surfaces 
or  dynamic  displays  of  variables  moving  over  time  in  some  appropriately 
defined  space.  These,  and  similar  techniques,  can  make  a  significant  Impact 
on  the  level  of  understanding  a  manager  can  have  of  a  situation  with  which 
he  is  not  directly  familiar. 

Related  to  this  increase  in  useful  information  Is  the  potential . that 
exists  in  the  'live'  screen  the  manager  is  viewing.  The  computer  'draws' 
the  Information  that  tlie  manager  is  using,  hence  if  it  is  'touched'  with 
the  light-pen  the  system  knows  exactly  what  is  being  pointed  at,  and  can 
respond  accordingly.  With  appropriate  programming  it  is  possible  to  pro- 
vide flexibility  yet  leave  the  manager  with  simple  commands  that  use  his 
terminology  and  simply  require  him  to  point  at  the  screen. 

Such  systems  have  been  built  and  successfully  tested  with  line  man- 
agers. Systems  design  and  software  architecture  Is  a  problem,  but  one 
that  can  be  solved.  Using  such  systems  managers  are  able  to  work  their 
way  through  their  problem  in  whatever  way  makes  sense  to  them.  They  can 
examine  the  data  along  any  dimension  that  appeals  to  them  and  by  so  doing 
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can  build  up  a  precir.o  view  of  the  problem.   This  clarification  process 
may  involve  filtering  tiic^  djis  through  models,  sensitivity  analysis  In 
testing  the  impact  of  altcniyl i ve  strategies  and  so  forth.  With  an  ap- 
propriate set  of  models  and  presentation  formats  it  is  possible  to  clarify 
the  problem  and  hence  move  effectively  toward  a  solution. 

2.  Fxploralion  of  Alternatives 

A  second  significant  impact  of  an  MDS  is  the  ability  to  explore  al- 
ternative strategies  in  the  solution  of  a  problem.  Planning  and  control, 
particularly  in  a  program  environment,  obviously  does  not  just  involve  a 
clear  view  of  historical  performance.  It  also  involves  adjustments  In 
current  activities  to  achieve  some  desired  future  performance. 

Given  the  clarified  and  common  position  achieved  with  the  MDS  In  the 
previous  step  of  the  process,  what  Is  now  required  is  the  next  and  more 
Important  ability  to  let  the  Impact  of  various  alternatives  be  seen  over 
time.  Having  the  manager  suggest  alternatives  and  having  the  system 
calculate  the  Impact  and  present  the  results  is  a  useful  combination.  The 
system  can  perform  those  tasks  for  which  it  is  most  suited,  rapid  computa- 
tion and  consistent  access  to  large  data  files — while  the  manager  can  use 
his  pattern  recognition  and  judgmental  skills. 

Given  a  clear  definition  of  a  current  problem  one  would  like  to  assess 
the  effectiveness  of  various  strategies  on  the  goals  of  the  program.  With 
the  technology  that  has  been  available  until  recently  this  has  been  diffi- 
cult. Batch  computers,  accounting  systems  and  the  data  collection  schemes 
have  often  been  historically  oriented.  Particular  planning  tools,  such  as 
PERT  and  PERT/COST  were  devised  to  offset  this  historical  bias  and  they 
have  been  a  considerable  improvement.  These  tools  are  awkward  to  use  as 
they  become  large,  and  their  viability  as  an  active  planning  tool  is  corres- 
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pondingly  reduced.   It  is  often  not  easy  to  take  a  large  netv/ork  and  test 
vcirious  alternatives  in  an  interactive  v;ay.  Similarly  for  control  purposes 
if  one  wishes  to  examine  data  along  criteria,  or  for  time  periods,  otiier 
than  those  established  in  the  system  it  is  difficult,  slow  and  expensive 
under  batch  systems. 

The  future  is  important  in  rrost  decision  situations  and  this  implies 
more  thnn  just  increasing  information  flow  to  buy  slack.  As  Galbralth 
correctly  points  out  in  his  paper,  increasing  the  flow  of  relevant  infor- 
mation will  buy  the  organization  some  slack.  This  is  the  sort  of  activity- 
we  discussed  in  (I)  above.  Perhaps  more  significant  Is  the  slack  the 

organization  can  buy  by  improving  the  planning  process.  Looking  into  the 
future  and  evaluating  current  trends  and  possible  new  strategies  can 
successfully  remove  the  crisis  aiiinsphere  of  jumping  from  fire  to  fire. 

An  MDS  can  do  fhis  by  allowing  the  manager  to  insert  alternatives 
and  tes1  them.  The  manager  can  take  one  strategy,  look  at  its  implica- 
tions over  time  along  any  relevant  dimensions,  then  try  some  other 
strategy  and  contrast  its  implication  in  soma  formal  way.  Such  systems 
have  been  built  and  tested  and  found  to  work  well.   In  the  normal  case 
they  involve  models  and  it  is  the  power  of  those  coupled  with  the  case 
with  v.lilch  managers  can  look  forward  in  time  that  provides  much  of  the 
benefit. 

5.   Managerial  Use  of  todels 

The  above  discussion  focused  on  the  importance  of  establishing  the 
effectiveness  of  strategies  over  time  and  strategies  that  have  been  designed 
to  solve  a  current  problem.  Clearly  this  means  that  explicit  formal 


Morion,  M.S.S.  and  McCosh,  A.M.,  "Terminal  Costing  for  Better  Decisions", 
Harvard  nu::incss  Review,  May-June  1968.  (footnote  continued  on  next  page) 
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models  are  involved.  An  MDS  implies  that  planning  rxsdels  arc  imbedded  in 
the  system.   Such  explicit  inclusion  of  formal  models  differentiates  the 
Managemont  Decision  System  from  a  Management  Information  System.   The 
inclusion  of  specific  models  to  support  a  particular  decision  maker  in 
solving  certain  aspects  of  his  key  problem  involves  a  careful  design  and 
Impleirientation  process.  One  that  is  significantly  different  from  the  tra- 
ditional approach  to  systems  design  that  is  inherent  in  many  actual  imple- 
mentations of  an  MIS. 

Models  have  hod  iimited  impact  on  lino  managers  thus  far.  This  has 
been  because  of  technological  limitations  and  our  lack  of  understanding  of 
where  models  can  be  effectively  used.  Only  certain  aspects  of  particular 
decisions  lend  themselves  to  economically  viable  rrodeling.  With  the  1cch- 
nology  discussed  above  and  the  insights  gained  from  research  into  managerial 
use  of  models  v/e  are  moving  toward  the  creation  of  a  cosi /effective  change 
In  the  planning  end  control  systems  available  to  managers. 

In  developing  such  an  MDS  it  is  important  to  work  v/ith  a  range  of  models. 
Starting  v/ith  simple  ones  ihot  apply  only  to  a  small  part  of  the  problem 
allows  both  the  designers  and  the  managers  to  learn.  As  the  manager  grows 
to  understand  the  rrodel,  ho  develops  the  right  degree  of  trust  in  its  output. 
More  importantly,  he  begins  to  see  where  additional  changes  can  be  made  and 

starts  to  bring  more  reality  into  the  model  in  those  areas  where  he  feels 
It  will  be  of  greatest  benefit.  This  evolutionary  design,  with  1he  decision- 
maker one  of  the  most  active  in  the  change  process  is  clearly  desirable. 
The  process  by  which  ft  occurred  in  one  experiment  is  traced  briefly  below. 


4  (cont.) 

Ness,  D,N.,  "Interactive  Budgofing  Models:   An  Txample,  "  MIT  V/orking 
Paper  No.  345-68. 

Morton,  M.S.S.  and  Stephens,  J.,  "The  Impact  of  Inleractive  Visual  Display 
Systems  on  the  Management  Planning  Process",  Proceedings  of  the  IFIP  Congress  68, 
Edinburgh,  Scotland,  August  1968.   Also  MIT  Working  Paper  Mo.  356-58. 
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The  three  maricigers  involved  v/ci  e  given  accor.s  to  exactly  the  same 
data  35  they  used  undor  the  Ton.ier,  largely  rnanur;!,  decision  process.  The 
only  explicit  rrodei  involved  v/.:i:.  a  batch  run  of  an  exponential  forecasting 
model.  The  MDS  offered  then,  grciphical  presentation  of  various  actual, 
planned  and  forecasted  dalo  v;liich  they  could  change  as  they  saw  fit.   In- 
itial response  during  the  cxpcri mental  period  v/as  very  favorable.  After 

six  nxsnths  of  use  of  the  system  they  were  able  to  move  from  5  full  days 
of  meetings  on  this,  problem  process  to  about  1/2  day.   The  availability 

of  some  slack  time,  plus  the  v;ay  in  which  the  system  pointed  up  Inconsis-  ' 

tencles  resulted  in  the  managers  beginning  to  be  concerned  with  the  quality 

of  their  own  decision  process.  They  began  to  make  suggestions  for  changes 

in  the  system  and  before  long  were  actively  involved  in  the  evolutionary 

development  of  their  MDS. 

After  a  furlher  year  of  use  and  continued  changes  to  the  data-base 

and  decision  process  we  are  now  beginning  to  get  some  concern  with  the 

quality  of  the  overall  decision  nwdel  they  are  using.  They  had  been  used 

to  having  an  internalized  Informal  model,  with  a  set  of  ill-defined  rules 

of  thumb,  which  they  used  to  identify  problems  and  evaluate  solutions.   The 

significant  feature  offered  to  thorn  by  the  MDS  is  access  to  their  decision 

process.  The  managers  were  asked  to  bo  explicit  about  their  decision  rules 

rules  as  to  what  they  regarded  as  a  problem  situation  and  rules  as  to  what 

constituted  a  'good'  solution.   For  many  managers  this  is  a  difficult  task. 

Their  rules  are  often  implicit  not  explicit,  they  have  not  been  used  to 

defining  or  discussing  them.  With  such  internalized  and  ambiguous  rules 
it  is  clear  that  there  must  be  occasions  when  inconsistent  decisions  are 

made  as  well  as  occasions  when  problems  are  not  detected  or  'better'  solu- 
tions not  found. 


5 
Morton,  M.S.S.,  Managemient  Decision  Systems ,  op.  cit. 
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With  the  use  of  the  MDS  the  rridiiacjcrs  develop  solutions  by  using  the 
linhl-pcn  on  the  display  screen.   The  computer  can  be  programmed  to  mon- 
itor this  and  maintain  a  trace  of  the  actual  displays  used  as  v/el  I  as  1he 
changes  made.   Similarly  the  conversations  among  the  managers  can  be  mon- 
itored by  the  use  of  a  tape  recorder. 

Afior  the  decision  process  is  over  the  displays  and  the  recorder  can 
be  replayed  and  iho  entire  process  repeated.   The  analysts  or  the  managers 
can  repeat  the  v/hole  session  or  par1s  over  and  over  again  if  they  v/ish. 
During  this  replay  one  can  lool^  for  hidden,  or  implicit  criteria  and  decision 
rules.  Patterns  are  Identified  that  can  be  tested  on  past  sessions  and  the 
actual  managers  Involved  can  react.  By  such  an  Iterative  process  one  can 
begin  to  develop  explicit  models  of  the  decision  process.  These  can  be 
modified  over  time  as  the  managers  Involved  begin  to  see  changes  and  incon- 
sistencies in  their  now  visible  Internal  models. 

This  slow  but  continuous  construction  of  decision  models  is  a  pov/erful 
process  for  several  reasons.  Perhaps  the  most  significant  is  that  it  re- 
sults in  some  transfer  of  a  manager's  talent  to  a  form  that  Is  Independent 
of  him.   If  he  should  leave,  rei I  re  or  bccomo  unavailable  for  any  reason 
then  the  organization  has  learned  something  from  him.   The  next  incumbent 
of  that  position  has  a  base  on  which  io  build  and  can  start  his  learning 
process  from  the  accumulated  and  explicit  'wisdom'  of  his  predecessors. 

This  process  allows  the  construction  of  a  set  of  built-in  filters — 
simple  decision  models— which  can  provide  the  managers  with  a  first  level 
of  intelligent  support  for  their  decision  process.   This  capturing  of  de- 
cision rules,  building  algorithms  and  heuristics  that  support  the  process 
Is  a  significant  change  in  our  traditional  approach  to  M.I.S. 
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This  is  obviously  an  oversimplified  view  of  the  process.   Different 
managers  operate  differently,  the  envi  ronifcnt  is  constaiitiy  chiinging — 
both  outside  the  company  and  inside.  However  our  experiments  have  sho'wn 
that  such  learning  can  take  place  and  it  can  be  a  significant  Improvement 
over  the  currently  Intuitive  process. 

The  inclusion  of  such  decision  models  is  one  characteristic  of  &"!  MDS. 
Also  included  should  be  access  to  any  relevant  planning  models.   A  planning 
modal  in  this  context  Is  one  that  supports  the  decision  maker  in  his  cval- 
u I  at  ion  of  alternative  strategies  in  the  future.   PERT  and  other  program 
managonvant  models  are  In  this  category.  Their  use  and  structure  In  the 
past  has  been  largely  geared  to  their  use  in  a  batch  environment.  There 
are  at  least  tv/o  major  changes  to  be  made  in  looking  at  such  techniques 
In  the  context  of  an  MDS. 

The  first  of  these  is  the  hierarchical  structure  that  should  exist  in 

the  model  and  the  second  the  user  oriented  command  structure  to  deal  with 

the  model.  A  large  complex  PERT  network  takes  time  to  compute — often  several 

hours  on  a  large  computer.  The  detail  involved  is  sometimes  necessary 

but  more  often  a  hugs  percentage  of  the  calculations  arc  Identical  to  the 

previous  iteration.  A  hierarchical  structure  will  allow  the  user  to  work 
at  the  level  of  aggregation  that  is  appropriate.  This  improves  the  response 

time  and  hence  allows  more  alternatives  to  be  tested  by  the  manager  In  the 

same  time  period.  Hierarchies  may  call  for  clever  ways  of  collapsing 

greater  detail  into  a  more  aggregate  and  smaller  representation  of  the 

model.   Research  is  underway  in  this  field  and  it  seems  clear  that  the 

use  of  aggregate  models  can  lead  to  their  inlcractivc  use  by  managers. 

Crowsion,  W.B.S.  and  I  r1on,  M.S.S.   "The  Design  of  Hierarchical  Systems",    J 
Sloan  School  of  Management  V.'orking  Paper  (forthcoming). 
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The  second  M::jor  change  from  ttio  current  use  of  planning  models  is 
the  ease  with  which  n'ian?g(irs  should  be  able  to  oblain  the  information  they 
require.  The  aspecis  of  ilio  nodt'l  that  the  user  sees  should  be  in  his 
language  and  able  to  be  uicJ  in  u   style  that  he  finds  comfortable.   Flexible, 
powerful  and  simple  access  to  tiic  models  and  information  in  the  system  is 
an  easy  statement  to  make  bui  o  difficult  one  to  Implement  well.   However 
it  is  an  important  foaturo,  and  if  not  effectively  implemented  can  block 
the  benefits  from  the  use  of  a  t'lDS. 

This  third  impact  of  1he  MDS  then  is  based  on  the  conclusion  of  formal 
models  in  the  system,  f'todels  built  by  managers  to  help  them  find  problems 
as  well  as  those  used  for  future  planning. 

4 .   Inclusion  of  Managerial  Judgment 

We  have  been  discussing  the  use  of  a  MDS  In  the  context  of  the  program 
management  function,  as  one  Important  instance  of  a  complex  unstructured 
series  of  decision  situaiions.  Unstructured  at  least  in  the  sense  of  not 
knowing  what  constitutes  a  problem,  or  what  represents  a  good  solution.   In 
such  problems  managerial  judgment  and  intuition  are  an  important  ingredient 
in  the  decision  process.  Hence  an  effective  solution  couples  these  man- 
agerial talents  wiih  the  system's  capabilities  for  rapid  retrieval,  comi- 
putatlon  and  consistency.  The  system  can  also  help  the  manager  be  more  con- 
sistent by  allowing  him  to  deal  In  a  more  structured  way  with  the  problem 
of  uncertainty.  Many  companies  do  not  make  explicit  their  attitudes  toward 
risk,  and  many  program  management  techniques,  such  as  PERT,  do  little  to 
remedy  this.  Taking  a  rigorous  approach  (see  for  example  Hammond,  John  S. 
ill,  "Better  Decision  with  Preference  Theory",  Harvard  Business  Review, 
November-December  1967)  toward  the  uncertainty  in  any  decision  and  the 
managers  attitude  toward  risk  can  lead  to  a  situation  where  the  manager 
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hcii.  much  firmer  buoo  on  which  to  b«so  his  intuilion.  One  can  then  doveiop 
preference  curves  which  con  be  used  in  conjunction  with  the  decision  maimers 
expectations  to  evuluaie  ihe  ircTst  profitable  decision  in  a  decision  tree 
representation  of  his  choice  [/Tocoss. 

This  approacli  has  been  discussed  extensively  in  the  literature  and  has 
very  obvious  advantages.   11s  use  has  been  severely  limited  in  practical 
situations,  due  In  part  to  the  difficulty  of  collecting  from  the  manager 
his  asscssraont  of  probabilities.   The  manager  in  turn  has  had  no  way  of  i;nowing 
the  company's  attitude  toward  risk.  Combining  these  problems  of  specifying 
risk,  with  the  need  for  flexible  structuring  of  the  problem  and  the  deter- 
mination of  the  economic  consequences  of  a  decision,  has  been  beyond  the 
capabilities  of  the  information  systems  we  hove  had  available.  This  situation 
is  clearly  changed  withanMDS.   It  offers  a  mechanism  by  which  the  manager 
can  interact  with  the  system — develop  his  preference  curves  and  test  the 
outcome  when  he  assigns  various  probabilities  to  the  events  involved. 

This  impact  of  the  system  is  significant  because  uncertainty  is  always 
present  in  a  business  probletn.  The  MDS  offers  a  practical  way  of  incorporating 
consistent  management  judgement  about  risk  into  the  decision  process.   The 
technology  is  powerful  enough  to  support  the  manager  witliout  his  having  to 
become  an  expert  in  the  mrrihematics  involved. 

^*  Joint  Decision  Process 

The  final  impact  of  the  MDS  to  be  raised  here  is  that  of  its  direct 

effect  on  the  comrnunf cation  process.   Working  with  the  display  tv/o  or  more 

managers  can  make  their  points  using  the  light-pen  and  have  the  system 

respond.   This  allows  them  to  pull  out  relevant  data,  or  implement  their 

suggestions  as  to  strategy  and  immediately  get  a  response.   The  implica- 
tions of  the  suggestion  are  then  apparent  to  all.  Other  managers  can  then 

call  for  further  daia  or  models  to  buttress  their  responses  to  the  initial 
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siji^iofisl  ion.  Sucli  interactive  use  where  the  system  is  responding  fast 
cnou^ili  to  match  the  decision  maixcr's  naiiirai  thinking  speed  is  a  dif- 
ferent level  of  support  then  has  been  available  from  traditional  MIS. 

For  exaT,ple  in  a  PERT/COST  situation  ivhere  the  program  manager  and 
two  of  his  major  project  managers  are  discussing  performance  to  date  and 
likely  future  protilems.   !f  one  of  the  projects  is  in  trouble,  the  manager 
involved  could  develop  his  strategy  for  its  solution  on  the  screen  and 
have  the  ndworlv  recalculated.   His  solution  when  implemented  out  over  time 
may  have  implications  for  other  aspects  of  the  program.  These  can  be  iden- 
tified then  and  there  by  the  other  managers  involved  and  solutions  developed 
for  them.  Such  iterative,  explicit,  analysis  provides  at  least  three  bene- 
fits. 

1.  By  making  the  implications  of  the  strategy  clear  it  focuses 
discussion  on  known  impacts,  not  on  hypothesized  impacts. 

2.  By  showing  the  implications  quickly  the  mancgers  can  all  be 
present  and  can  follow  through  on  their  strategies  in  one 
sitti  ng. 

3.  If  it  Is  easy  to  test  solutions,  noro  solutions  are  likely 

to  be  tried,  and  the  ones  that  are  tried  can  be  examined  from 
the  standpoinis  of  each  of  the  functions  involved. 

Working  from  the  same  set  of  facts,  managers  can  spend  their  time 
discussing  the  intangibles  and  otiicr  issues  that  are  not  accounted  for 
in  ihe  system.   Such  a  joint  process  whci'u  all  the  managers  that  are  in- 
volved can  sit  in  one  session  has  the  advaniage  of  bringing  the  relevant 
areas  of  expertise  together  at  one  point  in  time  and  combining  their 
skills  in  the  joint  soltuion  of  a  comnon  problem.   Focusing  on  the  sam,e 
issue,  agreeing  on  the  definition  of  the  problem,  all  examining  the  impli- 
cations of  various  solutions  and  each  raising  his  view  of  these  together 

with  altf'rnativc  suggestions — such  a  process  can  offer  significant  improve- 
ment over  many  current  decision  processes. 
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In  the  manufacturing  situation  raised  earlier  the  use  of  such  a 
system  had  three  importani  changos. 

a)  The  three  managers  involved  were  all  present  during  the  problem 
finding  and  problem  solving  process.  Both  the  marketing  and  the 
production  manager  were  able  to  bring  their  own  specialized 
knowledge  to  bear,  improving  the  quality  and  lowering  the  cost  of 
the  final  decision.  The  decision  process  was  speeded  up,  with 
the  rapid  response  of  the  display,  to  the  point  where  they  felt 
It  was  useful  to  be  present. 

b)  Looking  at  the  historical  performance  and  the  future  plans  from 
several  points  of  view,  together  with  the  comments  from  the 
different  functional  groups,  provided  a  very  clear  picture  of 
the  situation.  Such  clarification  focused  the  discussion  much 
more  directly  on  the  relevant  issues. 

c)  The  commitment  that  arose  from  such  clarification  was  significant. 

If  any  of  the  managers  argued  for  his  solution — in  the  face  of 

the  other  data  brought  to  the  screen  by  one  of  the  other  managers — 

then  his  position  was  clear  to  all  concerned.   For  example  suppose 

the  Sales  Manager  felt  he  could  sell  100,000  units  in  the  last 

quarter  of  the  year.  The  production  manager  might  not  be  able  to 

make  these  without  overtime,  thus  pushing  up  his  costs.  He  might 

"""  argue  that  the  sales  division  could  not  sell  that  many.   For 

support  he  could  coll  onto  the  screen  the  sales  for  the  same 

quarter  in  the  previous  three  years,  none  of  which  showed  sates 

of  more  than  75,000  units.   If  in  the  face  of  this  evidence  the 

sales  manager  still  claimed  ho  could  make  that  objective  then  the 

might  agree  tc  go  ahead.   However  his  commitrtient  was  sharply 

focused  and  would  not  be  forgotten  by  either  the  Division  or  Production 

Manager. 
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For  these  5>oi  is  of    reasons   the  coumiuni  ceitiori    level    between  nianagers 
sizes   shcir|)ly   v/i  ih    ih'.'   use  cif   such   a  sysiirm.      The,    improved  communication 
seems  to  affect  the  qu.Jily  of    llio   final    result  and  certainly    improves 
the  effectiveness  of  ihc  mniiri^ors    involved    in  the  decision  process. 

Cone  I  us  ions 

We  have  discussed  five  nirijor  kinds  of  impact  that  have  been  experienced 
with  the  use  of  a  MDS — !)   The  clarification  of  issues,  2)  The  ability  to 
deal  with  the  future,  3)  The  use  of  rrodels  to  support  the  decision  process., 
4)  The  capturing  and  explicit  use  of  managerial  judgment  and  5)  The  use 
of  joint  decision  sessions.  The  impacts  occur  partly  because  of  technological 
changes,  as  evidenced  by  the  hardware  behind  the  MDS,  and  partly  because  of 
conceptual  changes.  The  management  decision  system  differs  from  traditional 
management  information  systems  in  several  ways. 

The  MIS  has  often  focused  more  on  efficiency — reducing  the  cost  of 
accomplishing  some  task.  The  MDS  is  primarily  concerned  with  effectiveness — 
Improving  the  decision  process  itself,  not  just  providing  the  same  informa- 
tion as  before,  only  quicker.  That  is,  MDS  has  as  its  primary  purpose  the 
support  of  a  key  decision. 

The  MIS  is  often  mostly  concerned  with  information  for  functions  (mar- 
keting, production,  etc.)  of  the  business.   The  MDS  involves  access  to 
models  for  filtering  information  and  providing  computational  power  as  well 
as  flexible  access  to  the  information. 

These  systems  are  both  useful,  but  each  for  their  own  purpose.   It 
seems  Important  to  recognize  the  differences,  if  effective  use  is  to  be 
made  of  each.   Line  management  cannot  get  much  help  in  making  key  decisions 
for  many  aspects  of  the  program  management  task  from  a  traditional  MIS. 
Its  inflexibility,  slow  response  and  awkwardness  of  use  combine  to  restrict 
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iis  use  to  fairly  structured  tasks.   A  KDS  has  the  characteristics  that  a!  lov/ 
it  to  be  used  for  unstructured  managerial  decision  situations. 

It  is  being  asserted  that  the  MDS  approach  can  be  used  on  problems 
facing  high  level  managers.  That  is,  they  can  be  used  on  ill-structured 
problems  where  there  are  trade-offs  to  be  made,  for  example,  betv/een  cost, 
schedule,  technical  performance  and  risk.  To  have  an  impact  in  such  a  sit- 
uation the  system  should  have  fast  response,  a  graphic  capability  and  be  de- 
signed with  sofiv;are  to  support  the  managers'  natural  decision  processes. 

Second  generation  batch  computer  systems  cannot  effectively  support 
such  a  system,  but  many  of  the  third  generation  systems  can.  Computational 
power  alone  is  not  the  limitation.  Clearly,  for  example,  many  PERT/COST 
planning  and  control  systems  are  running  on  a  batch  system.  However  many 
of  such  systems,  once  they  have  been  created,  are  awkward  to  use  and  to 
change.  Managers  use  them,  but  mainly  for  structured  tasks  or  routine  re- 
ports.  In  son>s  systems  there  has  been  concrete  evidence  of  managers  ig- 
noring the  computer  based  PERT  system  because  of  excessive  rigidity,  slow 
response  and  unustible  reams  of  paper. 

This  is  not  to  gainsay  the  usefulness  of  a  PERT  system  run  on  a  batch 
computer  for  1he  initial  planning  of  the  project  or  for  solving  structured 
problems.   In  addition,  as  operational  support  for  many  of  the  staff  the  system 
has  and  will  continue  to  be  most  useful.  V/hat  is  being  asserted  is  that 
planning  and  control  techniques  become  even  more  useful  when  provided  through 
a  system  such  as  the  MDS  which  puts  the  senior  line  manager  In  direct  contact 
with  the  models  and  Information.   In  unstructured  situations  this  becomes 
important  as  he  can  use  his  judgment  to  ask  for  and  evaluate  whatever  in- 
formation he  feels  is  relevant.  This  ability  to  probe,  follow  through  on 
hunches  and  build  one's  own  s1 ructure  to  analyze  the  problem  is  a  key  ele- 
ment of  a  successful  tool  for  problem  solving  at  this  level  in  the  organization. 
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Thc  point  made  by  Galbraith  in  his  pnpor  would  seeni  to  be  enlirely 
correct — information  cati  be  used  to  buy  sornc  slack  in  the  process  of 
achieving  the  organizations  goal.  Perhaps  the  most  significant  way  of 
achieving  this  is  to  use  a  system  that  provides  access  to  more,  relevant, 
Information  as  well  as  access  to  models  and  computational  power.   In 
other  words  there  is  an  upper  limit  to  the  slack  that  can  be  'bouglit'  wiih 
the  use  of  more  information  of  the  sort  that  comes  from  'traditional'  in- 
formation systems.  However  If  we  can  filter  this,  and  augment  the  mana- 
gers' skills  with  relevant  models  then  we  have  the  possibility  of  orders 
of  magnitude  increases  in  the  slack  resources  v/e  free  up.  The  clever  com- 
bination of  the  manager  and  the  MDS  can  improve  the  program  management 
process  way  beyond  that  available  with  our  current  systems. 
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